New trends in natural language processing: statistical natural language processing.

New trends in natural language processing: statistical natural language processing.

The field of natural language processing (NLP) has seen a dramatic shift in both research direction and methodology in the past several years. In the past, most work in computational linguistics tended to focus on purely symbolic methods. Recently, more and more work is shifting toward hybrid methods that combine new empirical corpus-based methods, including the use of probabilistic and informa...

Statistical Natural Language Processing

4.0 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 199 4.1 Preliminaries . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 200 4.2 Algorithms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201 4.2.1 Composition . . . . . . . . . . . . . . . . . . . . . . . . . 201 4.2.2 Determinization . . . . . . . . . . . . . . . . . . . . . . . 206 4.2.3 Weight pu...

On Statistical Methods in Natural Language Processing

What is a statistical method and how can it be used in natural language processing (NLP)? In this paper, we start from a definition of NLP as concerned with the design and implementation of effective natural language input and output components for computational systems. We distinguish three kinds of methods that are relevant to this enterprise: application methods, acquisition methods, and eva...

Statistical Physics for Natural Language Processing

In this paper we study the Enertex model that has been applied to fundamental tasks in Natural Language Processing (NLP) including automatic document summarization and topic segmentation. The model is language independent. It is based on the intuitive concept of Textual Energy, inspired by Neural Networks and Statistical Physics of magnetic systems. It can be implemented using simple matrix ope...

Introduction to Non-Statistical Natural Language Processing